y 



S&ZFH030508 



Method and Arrangement for Arithmetic Encoding and Decoding 
Binary States and a Corresponding Computer Program and a 
Corresponding Computer-readable Storage Medium 

5 

Cross-Reference to Related Application : 

This application is a continuation of copending 
International Application No. PCT/EP03/04 654 , filed May 2, 
10 2003, which designated the United States and was not 
published in English. 

BACKGROUND OF THE INVENTION 

15 1. Field of the Invention 

The invention relates to a method and an arrangement for 
arithmetically encoding and decoding binary states and to a 
corresponding computer program and a corresponding 
20 computer-readable storage medium which may in particular be 
used in digital data compression. 

2. Description of the Related Art: 

25 The present invention describes a new efficient method for 
binary arithmetic coding. There is a demand for binary 
arithmetic coding in most different application areas of 
digital data compression; here, in particular applications 
in the fields of digital image compression are of special 

30 interest. In numerous standards for image coding, like e.g. 
JPEG, JPEG-2000, JPEG-LS and JPIG, methods for a binary 
arithmetic coding were defined. Newer standardization 
activities make also the future use of such coding 
technologies obvious in the field of video coding (CABAC in 

35 H. 264/AVC) [1] . 
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The advantages of arithmetic coding (AC) in contrast to the 
Huffman coding [2] which has up to now been used in 
practice, may basically be characterized by three features: 



5 1. By using the arithmetic coding, by simple adaptation 
mechanisms a dynamic adaptation to the present source 
statistic may be obtained (adaptivity) . 

2. Arithmetic coding allows the allocation of a non- 
10 integer number of bits per symbol to be coded and is 
therefore suitable to achieve coding results which 
illustrate an approximation of the entropy as the 
theoretically given lower bound (entropy approximation) 
[3] . 



15 



20 



3. Using suitable context models statistical bindings 
between symbols for a further data reduction may be 
used with arithmetic coding ( intersymbol redundancy) 
[4] . 

As a disadvantage of an application of the arithmetic 
coding, generally the increased calculation effort compared 
to Huffman coding is regarded. 



25 The concept of the arithmetic coding goes back to the basic 
documentation for information theory by Shannon [5] . First 
conceptional construction methods were firstly published by 
Elias [6] . A first LIFO (last-in-first-out) variant of the 
arithmetic coding was designed by Rissanen [7] and later 

30 modified [8] [9] [10] by different authors to the FIFO 
implementations (first-in-first-out) . 

All of those documents have the basic principle of 
recursive partial interval decomposition in common. 
35 Corresponding to the given probabilities P("0") and P( M 1") 
of two results {"0", "1"} of a binary alphabet a primarily 
given interval, e.g. the interval [0, 1), is recursively 
decomposed into partial intervals depending on the 
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occurrence of individual events. Here, the size of the 
resulting partial interval as the product of the individual 
probabilities of the occurring events is proportional to 
the probability of the sequence of individual events. As 
5 every event Si adds a contribution of H(Si) = -log (P (Si)) of 
the theoretical information content H(Si) of Si to the 
overall rate by the probability P(S i ) / a relation between 
the number N B ±t of bits for illustrating the partial 
interval and the entropy of the sequence of individual 
10 events results, which is given by the right side of the 
following equation : 

N Bil =-lo g n P(S0 = ~Z, l<>S p (Si) 

15 The basic principle, however, first of all requires a 
(theoretically) unlimited accuracy in the illustration of 
the resulting partial interval and apart from that it has 
the disadvantage that only after the coding of the last 
result may the bits for a representation of the resulting 

20 partial interval be output. For practical application 
purposes it was therefore decisive to develop mechanisms 
for an incremental output of bits with a simultaneous 
representation with numbers of a predetermined fixed 
accuracy. These were first introduced in the documents [3] 

25 [7] [11]. 

In Fig. 1, the basic operations for a binary arithmetic 
coding are indicated. In the illustrated implementation the 
current partial interval is represented by the two values L 

30 and R, wherein L indicates the offset point and R the size 
(width) of the partial interval, wherein both quantities 
are respectively illustrated using b-bit integers. The 
coding of a bit e {0, 1} is thereby basically performed in 
five substeps: In the first step using the probability 

35 estimation the value of the less probable symbol is 
determined. For this symbol, also referred to as LPS (least 
probable symbol), in contrast to the MPS (most probable 
symbol) , the probability estimation Plps is used in the 
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second step for calculating the width R LPS of the 
corresponding partial interval. Depending on the value of 
the bit to be coded L and R are updated in the third step. 
In the forth step the probability estimation is updated 
5 depending on the value of the just coded bit and finally 
the code interval R is subjected to a so-called 
renormalization in the last step, i.e. R is for example 
rescaled so that the condition Re [2 b ~ 2 , 2 b ~ 1 ] is fulfilled. 
Here, one bit is output with every scaling operation. For 
10 further details please refer to [10] . 

The main disadvantage of an implementation, as outlined 
above, now lies in the fact that the calculation of the 
interval width R L ps requires a multiplication for every 

15 symbol to be coded. Generally, multiplication operations, 
in particular when they are realized in hardware, are cost- 
and time-intensive. In several research documents methods 
were examined to replace this multiplication operation by a 
suitable approximation [11] [12] [13] [14]. Hereby, the 

20 methods published with reference to this topic may 
generally be separated into three categories. 

The first group of proposals for a multiplication-free, 
binary arithmetic coding is based on the approach to 

25 approximate the estimated probabilities P L ps so that the 
multiplication in the second step of Fig. 1 may be replaced 
by one (or several) shift and addition operation (s) [11] 
[14]. For this, in the simplest case the probabilities P LPS 
are approximated by values in the form of 2~ q with the 

30 integer q > 0 . 

In the second category of approximative methods it is 
proposed to approximate the value range of R by discrete 
values in the form (1/2 - r) , wherein r e {0} <u {2" k I k > 
35 0, k integer} is selected [15] [16] . 

The third category of methods is only known from the fact 
that here any arithmetic operations are replaced by table 
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accesses. To this group of methods on the one hand the Q- 
coder used in the JPEG standard and related methods, such 
as the QM- and MQ-coder [12], and on the other hand the 
quasi-arithmetic coder [13] belong. While the latter method 
5 performs a drastic limitation of the number b of bits used 
for the representation of R in order to obtain acceptably 
dimensioned tables , in the Q-coder the renormalization of R 
is implemented so that R may at least approximately be 
approximated by 1. This way the multiplication for 
10 determining R L ps is prevented. Additionally, the probability 
estimation using a table in the form of a finite state 
machine is operated. For further details please see [12]. 

SUMMARY OF THE INVENTION 

15 

It is the object of the present invention to provide a 
method and an arrangement for an arithmetic encoding and 
decoding of binary states and a corresponding computer 
program and a corresponding computer-readable storage 
20 medium which eliminate the mentioned disadvantages and in 
particular (a) do not require a multiplication, (b) allow a 
probability estimation without calculation effort and (c) 
simultaneously guarantee a maximum coding efficiency over a 
wide range of typically occurring symbol probabilities . 

25 

In accordance with a first aspect, the present invention 
provides a method for an arithmetic encoding and decoding 
of binary states, wherein in a first step a presetable 
value range for the specification of the interval width R 

30 is separated in K representative interval widths {Qi, 

Qk) f a presetable value range for the specification of the 
probabilities is separated in N representative probability 
states {Pi, P N } and allocation regulations are given, 

which allocate one Q K (1 < k < K) to every interval width R 

35 and one P n (1 < n < N) to every probability, and that in a 
second step the encoding or decoding of the binary states 
take place by performing the calculation of the new 
interval width to be derived in the encoding or decoding 
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process, respectively, using a representative interval 
width Q K (1 < k < K) and a representative probability state 
P n (1 < n < N) by arithmetic operations other than 
multiplication and division, wherein the representative 
5 interval width Q K is determined by the basic basis interval 
of the width R and the representative probability state P n 
is determined by the probability estimation underlying the 
symbol to be encoded or to be decoded according to the 
given allocation regulations. 

10 

In accordance with a second aspect, the present invention 
provides an arrangement having at least one processor 
and/or chip, which is/are implemented such that a method 
for an arithmetic encoding and decoding of binary states is 

15 may be performed, wherein in a first step a presetable 
value range for the specification of the interval width R 
is separated in K representative interval widths {Qi, 
Q K }, a presetable value range for the specification of the 
probabilities is separated in N representative probability 

20 states {Pi, P N } and allocation regulations are given, 

which allocate one Q K (1 < k < K) to every interval width R 
and one P n (1 < n < N) to every probability, and wherein in 
a second step the encoding or decoding of the binary states 
take place by performing the calculation of the new 

25 interval width to be derived in the encoding or decoding 
process, respectively, using a representative interval 
width Q K (1 < k < K) and a representative probability state 
P n (1 < n < N) by arithmetic operations other than 
multiplication and division, wherein the representative 

30 interval width Q K is determined by the basic basis interval 
of the width R and the representative probability state P n 
is determined by the probability estimation underlying the 
symbol to be encoded or to be decoded according to the 
given allocation regulations. 

35 

In accordance with a third aspect, the present invention 
provides a computer program which enables a computer after 
it has been loaded into the storage of the computer to 
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perform a method for an arithmetic encoding and decoding of 
binary states, wherein in a first step a presetable value 
range for the specification of the interval width R is 
separated in K representative interval widths {Qi, Q K K 
5 a presetable value range for the specification of the 
probabilities is separated in N representative probability 
states {Pi, P N } and allocation regulations are given, 

which allocate one Q K ( 1 < k < K) to every interval width R 
and one P n (1 < n < N) to every probability, and wherein in 

10 a second step the encoding or decoding of the binary states 
take place by performing the calculation of the new 
interval width to be derived in the encoding or decoding 
process, respectively, using a representative interval 
width Q K (1 < k < K) and a representative probability state 

15 P n (1 < n < N) by arithmetic operations other than 
multiplication and division, wherein the representative 
interval width Q K is determined by the basic basis interval 
of the width R and the representative probability state P n 
is determined by the probability estimation underlying the 

20 symbol to be encoded or to be decoded according to the 
given allocation regulations . 

In accordance with a fourth aspect, the present invention 
provides A computer-readable storage medium on which a 

25 computer program is stored which enables a computer after 
it has been loaded into the storage of the computer to 
perform a method for an arithmetic encoding and decoding of 
binary states, wherein in a first step a presetable value 
range for the specification of the interval width R is 

30 separated in K representative interval widths {Qi, Q K } , 

a presetable value range for the specification of the 
probabilities is separated in N representative probability 
states {Pi, P N } and allocation regulations are given, 

which allocate one Q K (1 < k < K) to every interval width R 

35 and one P n (1 < n < N) to every probability, and wherein in 
a second step the encoding or decoding of the binary states 
take place by performing the calculation of the new 
interval width to be derived in the encoding or decoding 
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process, respectively, using a representative interval 
width Q K (1 < k < K) and a representative probability state 
P n (1 < n < N) by arithmetic operations other than 
multiplication and division, wherein the representative 
5 interval width Q K is determined by the basic basis interval 
of the width R and the representative probability state P n 
is determined by the probability estimation underlying the 
symbol to be encoded or to be decoded according to the 
given allocation regulations. 

10 

One method for an arithmetic encoding and decoding of 
binary states is advantageously performed so that in a 
first step a presetable value range for the specification 
of the interval width R is separated in K representative 

15 interval widths {Qi, Q K K a presetable value range for 

the specification of the probabilities is separated in N 
representative probability states {Pi, P N } and 

allocation regulations are given, which allocate one Q K (1 
< k < K) to every interval width R and one P n (1 < n < N) 

20 to every probability, and that in a second step the 
encoding or decoding of the binary states take place by 
performing the calculation of the new interval width to be 
derived in the encoding or decoding process, respectively, 
using a representative interval width Q K (1 < k < K) and a 

25 representative probability state P n (1 < n < N) by 
arithmetic operations other than multiplication and 
division, wherein the representative interval width Q K is 
determined by the basic basis interval of the width R and 
the representative probability state P n is determined by 

30 the probability estimation underlying the symbol to be 
encoded or to be decoded according to the given allocation 
regulations . 

Another preferred implementation of the invention is 
35 characterized . by the fact that based on the interval 
currently to be evaluated with a width R for determining 
the associated interval width Q K an index q___index is 
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determined by a shift and bit masking operation applied to 
the computer-internal/binary representation of R. 

It is also advantageous when based on the interval 
5 currently to be evaluated with a width R for determining 
the associated interval width Q K an index q_index is 
determined by a shift operation applied to the computer- 
internal/binary representation of R and a downstream access 
to a table Qtab, wherein the table Qtab contains the 
10 indices of interval widths which correspond to the values 
of R which were pre-quantized by the shift operation. 

It is in particular advantageous when the probability 
estimation underlying the symbol to be encoded or decoded 
15 is associated to a probability state P n using an index 
p_state . 

It is also an advantage when the determination of the 
interval width R LPS corresponding to the LPS is performed by 

20 an access to the table Rtab, wherein the table Rtab 
contains the values corresponding to all K quantized values 
of R and to the N different probability states of the 
interval width R L ps as product values (Q K * P n ) • The 
calculation effort is reduced in particular when the 

25 determination of the interval width R LPS corresponding to 
the LPS is performed by an access to the table Rtab, 
wherein for evaluating the table the quantization index 
q_index and the index of the probability state p__state are 
used. 

30 

It is further provided that in the inventive method for the 
N different representative probability states transition 
rules are given, wherein the transition rules indicate 
which new state is used based on the currently encoded or 
35 decoded symbol for the next symbol to be encoded or 
decoded. It is hereby of an advantage when a table 
Next_State_LPS is created which contains the index m of the 
new probability state P m when a least probable symbol (LPS) 
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occurs in addition to the index n of the currently given 
probability state P n , and/or when a table Next_State_MPS is 
created which contains the index m of the new probability 
state P m when a most probable symbol (MPS) occurs in 
5 addition to the index n of the currently given probability 
state P n . 



An optimization of the method for a table-aided binary 
arithmetic encoding and decoding is achieved in particular 
10 by the fact that the values of the interval width R LPS 
corresponding to all K interval widths and to all N 
different probability states are filed as product values 
(Qk * P n ) in a table Rtab. 



15 A further optimization is achieved when the number K of the 
quantization values and/or the number N of the 
representative states are selected depending on the preset 
accuracy of the coding and/or depending on the available 
storage room. 

20 

One special implementation of the encoding in the inventive 
method includes the following steps: 



1. Determination of the LPS 
25 2. Quantization of R: 

q^index = Qtab[R»q] 
3. Determination of R L ps and R: 
Ru?s = Rtab [qL index / p_state] 
R = R Rlps 

30 4. Calculation of the new partial interval: 
if (bit : LPS) then 
L <— L + R 
R ^ — Rlps 

p_state <— Next_State_LPS [p_state] 
35 if (p_state = 0) then valMPS <- 1 - valMPS 

else 

p_state <— Next_ State_MPS [p_state] 



5. Renormalization of L and R, writing bits, wherein 



The decoding in a special implementation of the inventive 
method includes the following steps: 

1. Determination of the LPS 

2. Quantization of R: 
q_index = Qtab[R»q] 

3. Determination of R LPS and R: 
Rlps — Rtab [cj^index, p_state] 
R = R Rlps 

4. Determination of bit depending on the position of the 
partial interval: 

if (V > R) then 
bit <- LPS 
V <- V - R 
R ^ — Rlps 

if (p_state = 0) valMPS <- 1 - valMPS 
p_state <- Next_State_LPS [p_state] 

else 

bit <r- MPS 

p_state <— Next_State_MPS [p_state] 

5. Renormalization of R, reading out one bit and updating 
V, wherein 

<5_index describes the index of a quantization value 



p_state 

Rlps 



valMPS 



cj_index 



describes the index of a quantization value 

read out of Qtab, 

describes the current state, 

describes the interval width corresponding 
to the LPS and 

describes the bit corresponding to the MPS. 



p_state 

Rlps 



valMPS 



read out of Qtab, 

describes the current state, 

describes the interval width corresponding 
to the LPS, 

describes the bit corresponding to the MPS, 
and 



V 



describes a value from the interior of the 
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current partial interval. 

In another special implementation of the inventive method 
it is provided that in encoding and/or decoding the 
5 calculation of the quantization index q_index is performed 
in the second substep after the calculation regulation: 

q_index = (R » q) & Qmask 

10 wherein Qmask illustrates a bit mask suitably selected 
depending on K. 

If a uniform probability distribution is present a further 
optimization of the method for a table-aided binary 

15 arithmetic encoding and decoding may be achieved by the 
fact that in the encoding according to claim 12 the 
substeps 1 to 4 are performed according to the following 
calculation regulation : 
R <— R » 1 

20 if (bit = 1) then 
L <r- L + R 

or 

that the substeps 1 to 4 of the encoding according to claim 
12 are performed according to the following calculation 
25 regulation: 
Ii <— L « 1 
if (bit = 1) then 
L <— L + R 

and wherein in the last alternative the renormalization 
30 (substep 5 according to claim 12) is performed with doubled 
decision threshold values and no doubling of L and R is 
performed, and 

that in the decoding according to claim 13 the substeps 1 
to 4 are performed according to the following calculation 
35 regulation: 
R <- R »1 
if (V > R) then 
bit 1 
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V <— V - R 

else 

bit <- 0, 

or 

5 the substeps 1 to 5 of the decoding according to claim 13 
are performed according to the following calculation 
regulation: 

1. Reading out one bit and updating V 

2. Determination of bit according to the position of the 
10 partial interval: 

if (V > R) then 
bit <- 1 
V <— V - R 

else 

15 bit <- 0. 

It further turns out to be advantageous when the 
initialization of the probability models is performed 
depending on a quantization parameter SliceQP and preset 
20 model parameters m and n, wherein SliceQP describes the 
quantization parameter preset at the beginning of a slice 
and m and n describe the model parameters . 

It is also advantageous when the initialization of the 
25 probability models includes the following steps: 

1. preState = min(max(l, ( (m * SliceQP) »4)+n), 2*N) 

2. if (preState <=N) then 

p_state = N+l - preState 
valMPS = 0 

30 else 

p_state = preState - N 

valMPS = 1, 

wherein valMPS describes the bit corresponding to the MPS, 
SliceQP describes the quantization parameter preset at the 
35 beginning of a slice and m and n describe the model 
parameters . 
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One arrangement for an arithmetic encoding and decoding of 
binary states includes at least one processor which is/are 
implemented such that a method for an arithmetic encoding 
and decoding may be performed, wherein in a first step a 
5 presetable value range for the specification of the 
interval width R is separated in K representative interval 
widths {Qi, Q K }/ a presetable value range for the 

specification of the probabilities is separated in N 
representative probability states {Pi, P N } and 

10 allocation regulations are given, which allocate one Q K (1 

< k < K) to every interval width R and one P n (1 < n < N) 
to every probability, and wherein in a second step the 
encoding or decoding of the binary states take place by 
performing the calculation of the new interval width to be 

15 derived in the encoding or decoding process, respectively, 
using a representative interval width Q K (1 < k < K) and a 
representative probability state P n (1 < n < N) by 
arithmetic operations other than multiplication and 
division, wherein the representative interval width Q K is 

20 determined by the basic basis interval of the width R and 
the representative probability state P n is determined by 
the probability estimation underlying the symbol to be 
encoded or to be decoded according to the given allocation 
regulations . . 

25 

One computer program for an arithmetic encoding and 
decoding of binary states allows a computer, after it has 
been loaded into the storage of the computer, to perform an 
method for an arithmetic encoding and decoding, wherein in 

30 a first step a presetable value range for the specification 
of the interval width R is separated in K representative 
interval widths {Qi, Q K }, a presetable value range for 

the specification of the probabilities is separated in N 
representative probability states {Pi, P N } and 

35 allocation regulations are given, which allocate one Q K (1 

< k < K) to every interval width R and one P n (1 < n < N) 
to every probability, and wherein in a second step the 
encoding or decoding of the binary states take place by 
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performing the calculation of the new interval width to be 
derived in the encoding or decoding process, respectively, 
using a representative interval width Q K (1 < k < K) and a 
representative probability state P n (1 < n < N) by 
5 arithmetic operations other than multiplication and 
division, wherein the representative interval width Q K is 
determined by the basic basis interval of the width R and 
the representative probability state P n is determined by 
the probability estimation underlying for the symbol to be 
10 encoded or to be decoded according to the given allocation 
regulations . 

For example, such computer programs may be provided 
(against a certain fee or for free, freely accessible or 
password-protected) which may be downloaded into a data or 
communication network. The thus provided computer programs 
may then be made useable by a method in which a computer 
program according to claim 22 is downloaded from a network 
for data transmission, like for example from the internet 
to a data processing means connected to the network. 

For performing a method for an arithmetic encoding and 
decoding of binary states preferably a computer-readable 
storage medium is used on which a program is stored which 
25 allows a computer, after it has been loaded into the 
storage of the computer, to perform a method for an 
arithmetic encoding or decoding, wherein in a first step a 
presetable value range for the specification of the 
interval width R is separated in K representative interval 
30 widths {Qi, Q K } , a presetable value range for the 

specification of the probabilities is separated in N 
representative probability states {Pi, P N } and 

allocation regulations are given, which allocate one Q K (1 
< k < K) to every interval width R and one P n (1 < n < N) 
35 to every probability, and wherein in a second step the 
encoding or decoding of the binary states take place by 
performing the calculation of the new interval width to be 
derived in the encoding or decoding process, respectively, 
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using a representative interval width Q K (1 < k < K) and a 
representative probability state P n (1 < n < N) by 
arithmetic operations other than multiplication and 
division, wherein the representative interval width Q K is 
5 determined by the basic basis interval of the width R and 
the representative probability state P n is determined by 
the probability estimation underlying as the basis for the 
symbol to be encoded or to be decoded according to the 
given allocation regulations. 

10 

The new method is distinguished by the combination of three 
features. First of all, similar to the Q-coder the 
probability estimation is performed using a finite state 
machine (FSM) , wherein the generation of the N 
15 representative states of the FSM is performed offline. The 
corresponding transition rules are thereby filed in the 
form of tables . 

A second characteristic feature of the invention is a 
20 prequantization of the interval width R to a number of K 
predefined quantization values. This allows, with a 
suitable dimensioning of K an N, the generation of a table 
which contains all K x N combinations of precalculated 
product values R x P LPS for a multiplication-free 
25 determination of R LPS . 

For the use of the presented invention in an environment in 
which different context models are used among which also 
such with (almost) uniform probability distribution are 
30 located, as an additional (optional) element a separated 
branch is provided within the coding machine in which 
assuming an equal distribution the determination of the 
variables L and R and the renormalizat ion regarding the 
calculation effort is again substantially reduced. 

35 

As a whole the invention in particular provides the 
advantage that it allows a good compromise between a high 
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10 



coding efficiency on the one hand and a low calculating 
effort on the other hand. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other objects and features of the present 
invention will become clear from the following description 
taken in conjunction with the accompanying drawings, in 
which : 



Fig. 1 shows an illustration of the basic operations 

for a binary arithmetic coding; 
Fig. 2 shows a modified scheme for a table-aided 

arithmetic encoding; 
15 Fig. 3 shows the principle of the table-aided 

arithmetic decoding; 
Fig. 4 shows the principle of encoding or decoding, 

respectively, binary data having a uniform 

distribution; 

20 Fig. 5 shows an alternative realization of encoding or 

decoding, respectively, for binary data with a 
uniform distribution; and 
Fig. 6 shows the initialization of the probability 

models depending on a quantization parameter 

25 SliceQP and preset model parameters m and n. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 

30 First of all, however, the theoretical background is to be 
explained in more detail: 

Table-aided probability estimation 

35 As it was already mentioned above, the effect of the 
arithmetic coding relies on an estimation of the occurrence 
probability of the symbols to be coded which is to be as 
good as possible. In order to enable an adaptation to non- 
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stationary source statistics, this estimation needs to be 
updated in the course of the coding process. Generally, 
usually methods are used for this which operate using 
scaled frequency counters of the coded results [17]. If C LPS 
5 and C MPS designates counters for the occurrence frequencies 
of LPS and MPS , then using these counters the estimation 



Plps — 



-LPS 



-LPS 



MPS 



(1) 



10 may be performed and then the operation outlined in Fig. 1 
of the interval separation may be carried out. For 
practical purposes the division required in equation (1) is 
disadvantageous. It is often convenient and required, 
however, to perform a rescaling of the counter readings 

15 when a predetermined threshold value C max of the overall 
counter C Tot ai - Cmps + c lps is exceeded. (In this context it 
is to be noted that with a b-bit representation of L and R 
the smallest probability which may be indicated correctly 
is 2" b+2 , so that for preventing that this lower limit is 

20 fallen short of, if necessary a rescaling of the counter 
readings is required.) With a suitable selection of C ma x the 
reciprocal values of C To tai may be tabulated, so that the 
division required in equation (1) may be replaced by a 
table access and by a multiplication and shift operation. 

25 In order to prevent also these arithmetic operations, 
however, in the present invention a completely table-aided 
method is used for the probability estimation. 

For this purpose in a training phase representative 
30 probability states { P K I 0 < k < N max } are preselected, 
wherein the selection of the states is on the one hand 
dependent on the statistics of the data to be coded and on 
the other hand on the side conditions of the default 
maximum number N max of states. Additionally, transition 
35 rules are defined which indicate which new state is to be 
used for the next symbol to be coded based on the currently 
coded symbol. These transition rules are provided in the 
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form of two tables: { Next_State_LPS K I 0 < k < N max } and 
{Next_State_MPS k I 0 < k < N max }, wherein the tables provide 
the index m of the new probability state P m when an LPS or 
MPS occurs, respectively, for the index n of the currently 
5 given probability state. It is to be noted here, that for a 
probability estimation in the arithmetic encoder or 
decoder, respectively, as it is proposed herein, no 
explicit tabulation of the probability states is required. 
Rather, the states are only implicitly addressed using 

10 their respective indices, as it is described in the 
following section. In addition to the transition rules it 
needs to be specified at which probability states the value 
of the LPS and MPS needs to be exchanged. Generally, there 
will only be one such excellent state which may be 

15 identified using its index p_state. 

Table-aided interval separation 

Fig. 2 shows the modified scheme for a table-aided 

20 arithmetic coding, as it is proposed herein. After the 
determination of the LPS, first of all the given interval 
width R is mapped to a quantized value Q using a tabulated 
mapping Qtab and a suitable shift operation (by q bit) . 
Alternatively, the quantization may in special cases also 

25 be performed without the use of a tabulated mapping Qtab 
only with the help of a combination of shift and masking 
operations. Generally, here a relatively coarse 
quantization to K = 2 ... 8 representative values is 
performed. Also here, similar to the case of the 

30 probability estimation, no explicit determination of Q is 
performed; rather, only an index q_index is transferred to 
Q. This index is now used together with the index p__state 
for a characterization of the current probability state for 
the determination of the interval width R LPS . For this, now 

35 the corresponding entry of the table Rtab is used. There, 
the K • N max product values R x P L ps, that correspond to all 
K quantized values of R and the N ma x different from the 
probability states, are entered as integer values with an 
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accuracy of generally b-2 bits. For practical 
implementations a possibility is given here to weigh up 
between the storage requirements for the table size and the 
arithmetic accuracy which finally also determines the 
5 efficiency of the coding. Both target variables are 
determined by the granularity of the representation of R 
and P L ps. 

In the forth step of Fig. 2 it is shown, how the updating 
10 of the probability ' state p_state is performed depending on 
the above coded event bit. Here, the transition tables 
Next_State_LPS and Next_State_MPS are used which were 
already mentioned above in the section "table-aided 
probability estimation". These operations correspond to the 
15 updating process indicated in Fig. 1 in step 4 which is not 
explained in more detail. 

Fig. 3 shows the corresponding flow chart of the table- 
aided arithmetic decoding. For characterizing the current 

20 partial interval in the decoder the interval width R and a 
value V is used. The latter is present within the partial 
interval and is refined successively with every read-out 
bit. As it may be seen from Fig. 3, the operations for the 
probability estimation and the determination of the 

25 interval width R are performed according to those of the 
encoder . 

Coding with uniform probability distribution 

30 In applications in which e.g. signed values are to be coded 
whose probability distribution is arranged symmetrically 
around zero, for coding the sign information generally an 
equal distribution may be assumed. As this information is 
one the one hand to be embedded in the arithmetic bit 

35 stream, while it is on the other hand not sensible to use a 
relatively compact apparatus of the table-aided probability 
estimation and interval separation for the case of a 
probability of p « 0.5, it is for this special case 
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proposed to optionally use a special encoder/decoder 
procedure which may be illustrated as follows. 

In this special case the interval width of the new partial 
5 interval may be determined in the encoder by a simple shift 
operation corresponding to a bisection of the width of the 
original interval R. Depending on the value of the bit to 
be coded, the upper or lower half of R, respectively, is 
then selected as a new partial interval (see Fig. 4). The 
10 subsequent renormalizat ion and output of bits is performed 
as in the above case of the table-aided solution. 

In the corresponding decoder the required operations are 
reduced to determining the bit to be decoded using the 

15 value of V relatively to the current interval width R by a 
simple comparison operation. In the case that the decoded 
bit is set, V is to be reduced by the amount of R. As it is 
illustrated in Fig. 4, the decoding is ended by the 
renormalization and updating of V using the bit to be read 

20 in next. 

An alternative realization of the coding of events with a 
uniform probability distribution is illustrated in Fig. 5. 
In this exemplary implementation the current interval width 

25 R is not modified. Instead, V is first doubled by a shift 
operation in the encoder. Depending on the value of the bit 
to be coded, then, similar to the above example, the upper 
or lower half, respectively, of R is selected as a new 
partial interval (see* Fig. 5). The subsequent 

30 renormalization and output of bits is performed as in the 
above case of the table-aided solution with the difference 
that the doubling of R and L is not performed and that the 
corresponding comparison operations are performed with 
doubled threshold values. 

35 

In the corresponding decoder of the alternative realization 
first of all a bit is read out and V is updated. The second 
step is performed in the same way as step 1 in Fig. 4, i.e. 
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the bit to be decoded is determined using the value of V 
relative to the current interval width R by a simple 
comparison operation, and in the case in which the decoded 
bit is set, V is to be reduced by the amount of R (see Fig. 
5 5) . 

Addressing and initializing the probability models 

Every probability model, as it is used in the proposed 
10 invention, is indicated using two parameters: 1) The index 
p_state that characterizes the probability state of the 
LPS, and 2) the value valMPS of the MPS. Each of these two 
variables needs to be initialized at the beginning of the 
encoding or decoding, respectively, of a completed coding 
15 unit (in applications of video coding about one slice) . The 
initialization values may thereby be derived from control 
information, like e.g. the quantization parameter (of a 
slice), as it is illustrated as an example in Fig. 6. 

20 . Forward-controlled initialization process 

A further possibility of adaptation of the starting 
distributions of the models is provided by the following 
method. In order to guarantee a better adaptation of the 

25 initializations of the models, in the encoder a selection 
of predetermined starting values of the models may be 
provided. These models may be combined into groups of 
starting distributions and may be addressed using indices, 
so that in the encoder the adaptive selection of a group of 

30 starting values is performed and is transmitted to the 
decoder in the form of an index as page information. This 
method is referred to as a forward-controlled 
initialization process. 

35 While this invention has been described in terms of several 
preferred embodiments, there are alterations, permutations, 
and equivalents which fall within the scope of this 
invention. It should also be noted that there are many 
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alternative ways of implementing the methods and 
compositions of the present invention. It is therefore 
intended that the following appended claims be interpreted 
as including all such alterations, permutations, and 
5 equivalents as fall within the true spirit and scope of the 
present invention . 
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